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DESIGNING INTERCONNECT FABRICS 

This is a continuation-in-part of U.S. Application No. 09/707,227, filed 
November 16, 2000, the contents of which are hereby incorporated by 
reference. 

Field of the Invention: 

The present invention pertains to the field of networks. More 
particularly, this invention relates to designing interconnect fabrics of 
networks. 

Background of the Invention: 

A wide variety of networks may be viewed as a set of source nodes that 
communicate with a set of terminal nodes via an interconnect fabric. For 
example, a storage area network may be arranged as a set of computers as 
source nodes which are connected to a set of storage devices as terminal nodes 
via an interconnect fabric that includes communication links and devices such 
as hubs, routers, switches, etc. Devices such as hubs, routers, switches, etc., 
are hereinafter referred to as interconnect devices. 

The communication requirements of an interconnect fabric may be 
characterized in terms of a set of flow requirements. A typical set of flow 
requirements specify the required communication bandwidth from each source 
node to each terminal node. The design of an interconnect fabric usually 
involves selecting the appropriate arrangement of physical communication 
links and interconnect devices and related components that will meet the flow 
requirements. 

Prior methods for designing interconnect fabrics are usually based on 
manual design techniques. Such manual techniques may be based on heuristics 
and/or prepackaged structures. Unfortunately, such techniques are usually 
error prone and may result in an over-provisioned interconnect fabric that is 
more expensive than needed to meet the flow requirements. Moreover, such 
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techniques are usually time-consuming and may require expert intervention, 
thereby increasing design costs. 

Summary of the Invention: 
5 A technique is disclosed for designing an interconnect fabric for 

communication between a set of source nodes and a set of terminal nodes. The 
technique may be used to efficiently and programmatically produce cost- 
effective interconnect fabrics over a range of design problems. 

In one aspect, a method is provided for designing an interconnect fabric 
10 for communication between a set of source nodes and a set of terminal nodes. 
A design for an interconnect fabric is obtained that has an interconnect device 
□ layer. The layer is adjacent to either the set of source nodes or the set of 

fy terminal nodes. Flow sets that traverse the layer of interconnect devices are 

in identified. A pair of the flow sets are merged thereby alleviating at least one 

y 15 port violation. The design may then be implemented. 

The merging may add a second interconnect device layer to the design. 
I'U The method may be repeatedly performed, adding additional interconnect 

i.n device layers, until port violations are no longer present in the design 

I* In another aspect, a system for designing an interconnect fabric for 

20 communication between a set of source nodes and a set of terminal nodes is 
provided. A design for an interconnect fabric has at least one interconnect 
device layer. A fabric design tool modifies the design for the interconnect 
fabric by identifying flow sets that traverse the layer of interconnect devices 
and merging a pair of the flow sets, thereby alleviating at least one port 
25 violation. 

The fabric design tool may add a second interconnect device layer to the 
design by merging a pair of the flow sets. The fabric design tool may 
repeatedly add additional interconnect device layers to the design until port 
violations are no longer present in the design. 
30 In a further aspect, a method of designing an interconnect fabric for 

communication between a set of source nodes and a set of terminal nodes is 
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provided. A design for an interconnect fabric is obtained having a interconnect 
device layer adjacent to either the set of source nodes or the set of terminal 
nodes. Interconnect device layers are formed adjacent to either the set of 
source nodes or terminal nodes, and are, thus, added to the design, until the 
5 design satisfies a set of flow requirements between the source nodes and 

terminal nodes without port violations. To form the interconnect device layers, 
flow sets that traverse the interconnect device layer may be identified and pairs 
of the flow sets merged. 

Other features and advantages of the present invention will be apparent 
10 from the detailed description that follows. 

Brief Description of the Drawings : 

The present invention is described with respect to particular exemplary 
embodiments thereof and reference is accordingly made to the drawings in 
15 which: 

Figure 1 shows a method for designing an interconnect fabric according 
to an embodiment of the present invention; 

Figures 2-6 shows an evolving arrangement of flow sets in an 
interconnect fabric for an example design according to an embodiment of the 
20 present invention; 

Figure 7 shows a fabric design tool that may employ techniques of the 
present invention to generate an interconnect fabric design in response to a set 
of design information; 

Figure 8 shows a method for resolving port violations by adding layers 
25 to the interconnect fabric in accordance with an embodiment of the present 
invention; and 

Figures 9-12 show an evolving arrangement of flow sets in an 
interconnect fabric for another example design according to an embodiment of 
the present invention. 

30 
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Detailed Description of a Preferred Embodiment: 

Figure 1 shows a method 200 for designing an interconnect fabric 
according to an embodiment of the present invention. The method 200 
partitions the flow requirements of the interconnect fabric into flow sets and 
5 iteratively merges the flow sets while taking into account the feasibility and 
cost of the implementing the interconnect fabric. 

At step 20, an arrangement of flow sets in the interconnect fabric is 
determined in response to a set of flow requirements for the source and 
terminal nodes. In one embodiment, step 20 is performed by generating a flow 
10 set for each flow specified in the flow requirements for the interconnect fabric. 

Table 1 shows an example set of flow requirements for an interconnect 
fabric under design. 





Terminal 
Node 50 


Terminal 
Node 52 


Terminal 
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Source 
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Source 
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Source 
Node 44 
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15 The flow requirements in this example specify three source nodes 

(source nodes 40-44 in the figures below) and three terminal nodes (terminal 
nodes 50-54 in the figures below). If an interconnect fabric is to meet the flow 
requirements, it must contain communication paths between all pairs of the 
source and terminal nodes 40-44 and 50-54 having positive flow requirements 

20 and must have sufficient bandwidth to support all of the flow requirements 
simultaneously. 
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In one embodiment, the source nodes 40-44 are host computers and 
terminal nodes 50-52 are storage devices and the bandwidth values a-h are 
numbers expressed in units of megabits per second. Thus, the interconnect 
fabric under design may be storage area network. 
5 In other embodiments, there may be multiple flow requirements between 

a given source and terminal node pair. In such embodiments, the cells of Table 
1 would contain a list of two or more entries. 

Figure 2 shows an initial arrangement of flow sets in the interconnect 
fabric obtained at step 20 for this example. Initially, a flow set is generated for 

10 each flow set forth in the flow requirements. Accordingly, a flow set having a 
flow of a is generated for a connection between the source node 40 and the 
terminal node 50, a flow set having a flow of b is generated for a connection 
between the source node 40 and the terminal node 52, and a flow set having a 
flow of c is generated for a connection between the source node 40 and the 

15 terminal node 54. Similarly, flow sets having flows of d, e, and f, respectively, 
are generated for connections from the source node 42 to the terminal nodes 
50-54 and flow sets having flows of g and h, respectively, are generated for 
connections from the source node 44 to the terminal nodes 52-54. 

At step 22, port violations which are associated with the arrangement of 

20 flow sets in the interconnect fabric are determined. Port violations are 
determined for each source node 40-42 and each terminal node 50-52. In 
general, the number of port violations for a node is equal to the sum, over all 
flow sets, of the number of required physical communication links to the node 
from that flow set, minus the number of available ports in the node because 

25 each flow set may require one or more physical communication links to a given 
source or terminal node in the network. In this example, the number of port 
violations for a node is equal to the number of flow sets connected to the node 
minus the number of available ports in the node because each flow set is 
carried by one physical communication link in the interconnect fabric. 

30 In this example, each source node 40-42 and each terminal node 50-52 

has two available ports for connections to the interconnect fabric. Therefore, 
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the source node 40 has a port violation of one since each of its three flow sets 
requires one physical communication link to the source node 40 and the source 
node 40 has only two available ports. Similarly, the source nodes 42-44 have 
port violations of one and zero, respectively, and the terminal nodes 50-54 have 
5 port violations of zero, one, and one, respectively, in the interconnect fabric. In 
other examples, the number of available ports on the source nodes 40-42 and 
the terminal nodes 50-52 may differ and the number of physical 
communication links required by a flow set on a given source or terminal node 
it connects to may exceed one. 

10 At step 24, at least one of the port violations is alleviated by merging a 

pair of the flow sets. Step 24 initially involves selecting the pair of flow sets in 
the current interconnect fabric that are to be merged. Initially, a candidate pair 
of flow sets is chosen that would alleviate the port violation on a node with the 
greatest port violation if merged. If there is more than one such candidate pair 

15 then one of the candidate pairs that alleviates a port violation on a node having 
the next greatest port violation is chosen from among them. If there is more 
than one such candidate pair then a pair of them that would be least costly to 
merge is chosen. The cost of merging two candidate pairs may be determined 
by choosing the least expensive interconnect device that is feasible for the 

20 merged flow set. 

In the current state of the example interconnect fabric shown in Figure 2, 
the source nodes 40-42 and the terminal nodes 52-54 each have a port violation 
of one, which is the worst port violation in the network, and their 
corresponding flow sets are candidates for merging at step 24. For example, 

25 the pair of flow sets having flows a and b or the pair of flow sets having flows a 
and c or the pair of flow sets having flows b and c are chosen as candidate 
pairs. All of these candidate pairs if merged would alleviate one port violation 
from the source node 40 but none of them would alleviate any other port 
violations. The same may be said for mergers of any two of the flow sets 

30 having flows d, e, and f, any two of the flow sets having flows b, e, and g, and 
any two of the flow sets having flows c, f, and h. Therefore, the cost of 
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merging the candidate pairs is used to select the candidate pair of flow sets 
having flows b and c for merger at step 24. For example, the communication 
link and/or interconnect device and/or ports that are used to merge the flow sets 
having flows b and c may be less expensive than the equivalent components 
5 needed to merge the other equally qualified candidate pairs. 

The candidate pairs of flow sets considered at step 24 must be feasible to 
merge. An example of a pair of flow sets that is not feasible to merge is a pair 
for which an interconnect device of sufficient bandwidth is not available. For 
example, a flow set having 60 units of bandwidth cannot be merged with a flow 

10 set having 50 units of bandwidth if the highest bandwidth interconnect device 
available is 100 units. Another example of a pair of flow sets that is not 
feasible to merge is a pair that would exceed the available ports on every 
available interconnect device of the resulting flow set. Candidate pairs that are 
not feasible to merge are bypassed at step 24 in favor of other candidate pairs. 

15 If port violations still exist in the interconnect fabric after step 24, then 

another candidate pair of flow sets is selected and merged in a repeat of step 
24. The method 200 loops through steps 22-24 in an iterative fashion until all 
port violations are eliminated or until no further merges are feasible. 

Figure 3 shows an interconnect fabric that results from the first pass 

20 through step 24. A flow set having an interconnect device 160, a flow of b, and 
a flow of c is the result of the merger of the flow set having the flow of b and 
the flow set having the flow of c. At this point, the interconnect fabric has a 
port violation of one at the source node 42 and a port violation of one at each of 
the terminal nodes 52 and 54. The next pass through step 24 results in the 

25 selection and merger of the flow set corresponding to the interconnect device 
160 with the flow set having the flow of e which will alleviate the port 
violation of the terminal node 52. 

Figure 4 shows an interconnect fabric that results from the second pass 
through step 24. The flow set corresponding to the interconnect device 160 

30 now carries the flow of e in addition to the flows of b and c. At this point, the 
interconnect fabric has a port violation of one at the source node 42 and a port 
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violation of one at the terminal node 54. The next pass through step 24 results 
in the selection and merger of the flow set having the flow of f with the flow 
set corresponding to the interconnect device 160 which will alleviate the port 
violation of the source node 42 as well as the port violation of the terminal 
5 node 54. 

Figure 5 shows an interconnect fabric that results from the third pass 
through step 24. The flow set corresponding to the interconnect device 160 
now carries the flow of f as well as the flows b, c, and e. At this point, the 
interconnect fabric has no port violation remaining. However, a cost saving 

10 may be obtained by merging the flow set having the flow of a into the flow set 
corresponding to the interconnect device 160. That merger would obviate the 
need for a communication link between the source node 40 and the terminal 
node 50, replacing that link with one between the interconnect node 160 and 
the terminal node 50, and thereby saving the costs associated with a port on the 

15 source node 40 in exchange for the lower costs, in this example, of a port on 
the interconnect node 160. 

Figure 6 shows an interconnect fabric that results from merging the flow 
set having the flow of a into the flow set corresponding to the interconnect 
device 160. The flow set corresponding to the interconnect device 160 now 

20 includes the flow a in addition to the flows of b, c, e, and f . At this point, the 
interconnect fabric has no port violation remaining and no remaining 
opportunities for cost saving. 

In this embodiment, each flow set has at most one interconnect device 
associated with it and all of the flows for the flow set are routed through that 

25 interconnect device or a single communication link if possible. When a pair of 
flow sets are merged, their existing interconnect devices, if any, are replaced by 
a single interconnect device which may be of a different type than the replaced 
interconnect devices. Usually, the interconnect device that results in the least 
expensive routing of the flows in the flow set is chosen from among those 

30 interconnect devices that are feasible for the flow set. 
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Figure 7 shows a system having a fabric design tool 100 that may 
employ the method 200 to generate an interconnect fabric design 124 in 
response to a set of design information 130. The fabric design tool 100 may be 
implemented in software and/or hardware to perform its functions. The design 
5 information 130 in one embodiment includes a list of hosts (source nodes) and 
devices (terminal nodes) 1 10, a list of fabric node types 1 12, a list of link type 
data 1 14, a set of flow requirements data 1 16, a set of port availability data 118, 
a set of bandwidth data 120, and a set of cost data 122. The design information 
130 may be implemented as an information store, such as a file or set of files, 
10 or a database, etc. 

The list of hosts and devices 110 may specify the hosts and devices 
which are to be interconnected by the interconnect fabric design 124. 

The list of fabric node types 112 may specify available interconnect 
devices, such as hubs, routers, switches, etc. 
15 The link type data 1 14 may specify a list of available communication 

links that may be employed in the interconnect fabric design 124 and any 
relevant constraints. There are numerous examples of available 
communication links including fiber optic links, fibre channel links, wire-based 
links, and links such as SCSI as well as wireless links. 
20 The flow requirements data 116 may specify the desired flow 

requirements for the interconnect fabric design 124. The desired flow 
requirements may include bandwidth requirements for each pairing of the 
source and terminal nodes. 

The port availability data 118 may specify the number of 
25 communication ports available on each source node and each terminal node 
and each available interconnect device. 

The bandwidth data 120 may specify the bandwidth of each host and 
device port and each type of fabric node and link. 

The cost data 122 may specify costs associated with the available 
30 communication links and interconnect devices that may be employed in the 

interconnect fabric design 124. The cost data 122 may also specify the costs of 
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ports for source and terminal nodes and interconnect devices. Other relevant 
costs may also be indicated. 

The interconnect fabric design 124 generated by the fabric design tool 
100 includes a list of the physical communication links and interconnect 
5 devices and ports, etc. and may include cost data. 

In some cases, an existing design for an interconnect fabric may not be 
entirely satisfactory. For example, the method 200 generally results in a fabric 
design of a single layer in which there are no links between device nodes. 
Under certain circumstances, a single-layer fabric may not eliminate all of the 
10 port violations. In which case, the method 200, by itself, may not result in a 
u fabric design in which there are no port violations. This can occur due to 

various factors, such as flow requirements and port availability limits at the 
I* source, terminal and/or device nodes. Other design techniques, such as manual 

f1 or other methods, may also result in a design for an interconnect fabric which is 

C 15 not entirely satisfactory. 

a As an example of design in which there exist port violations, assume 

: that the set of design information 1 30 includes the flow requirements as given 

^ in Table 1 and also includes additional constraints on port availability. The 

* additional port availability constraints, for this example, may be that instead of 

20 two ports, the source node 40 and the terminal node 52 each have only one port 
and that available interconnect devices cannot exceed four ports. With these 
constraints, the configuration of Figure 6 would not be possible because it 
requires that the device node 160 have five ports. 

Returning to Figure 5, given the further constraints, there still exist port 
25 violations on source node 40 and on terminal node 52. Because the nodes 40 
and 52 have two flows connected to them, but only one port, the port violation 
for each is one. However, no additional merges of flow sets are feasible using 
the method 200. For example, to relieve the port violation at source node 40, 
the flow set having flow a would need to be merged with the flow set having 
30 flows b and c. However, the flow set having flows b and c has already been 
merged by the device 160 and the device 160 cannot connect flow a to terminal 
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node 50 because all of the ports of the device 160 are already in use. Similarly, 
to relieve the port violation at terminal node 52, the flow set having flows b and 
e would need to be merged with the flow set having flow g. However, the flow 
set having flows b and e has already been merged by the device 160 and the 
5 device 160 cannot connect flow g to terminal node 52 because all of ports of 
the device 160 are already in use. 

Thus, in one embodiment, the present invention addresses remaining 
port violations in an obtained interconnect fabric by recursively generating 
additional layers of interconnect fabric nodes. For port violations at source 
10 nodes, the problem (i.e. the current fabric configuration and the applicable 
u design information) may be recast such that the device nodes are treated as the 

;;;; terminal nodes. Then, one or more additional layers of device nodes may be 

{ u s inserted between the source nodes and the device nodes to relieve the port 

■<n violations at source nodes. This results in links between device nodes and, 

m 

p 15 thus, increases the number of layers in the interconnect fabric. Similarly, for 
U terminal port violations, the problem may be recast such that the device nodes 

are treated as the source nodes. Then, one or more additional layers of device 
lj? nodes may be inserted in between the device nodes and the terminal nodes to 

* relieve the terminal node port violations. This also results in links between the 

20 device nodes and, thus, increases the number of layers in the interconnect 
fabric. 

Figure 8 shows a method 300 for resolving port violations by adding 
layers to an existing interconnect fabric in accordance with an embodiment of 
the present invention. The design tool 100 of Figure 1 may implement the 

25 method 300. Further, the method 300 may be continuation of the method 200 
of Figure 1 in which an interconnect fabric is obtained that may include port 
violations. In which case, a step 302 in Figure 8 may follow the step 24 of 
Figure 1 . Alternately, rather than the technique of Figure 1, another technique 
for forming an interconnect fabric, such as manual or other methods, may be 

30 employed to obtain an interconnect fabric prior to employing the method 300. 



11 



Atty. Dkt. No. 10019699-1 



In the step 302, a determination may be made as to whether there exist 
any port violations at source nodes. Assuming there is one or more such port 
violations, step 304 may be performed. As mentioned, for the example of 
Figure 5 with the additional port availability constraints, there is a port 
violation of degree one at the source node 40. At step 304, the device nodes 
may be recast as terminal nodes. 

Figure 9 shows an interconnect fabric that has been recast in accordance 
with an embodiment of the invention. In step 304, a layer of existing 
interconnect fabric devices that is adjacent to the source nodes that have port 
violations may be identified. In the example of Figure 9, the existing fabric 
includes a single layer 400 of existing devices. As such, the layer 400 is 
adjacent to the source nodes 40, 42 and 44. For links which pass through the 
adjacent layer 400 without terminating at a device node, "dummy" nodes may 
be inserted in the layer 400. Thus, each link which enters the layer 400 
terminates at either a device node or a dummy node. In the example of Figure 
9, the links for flows a, d, g and h pass through the layer 400 without 
terminating at a device node. Accordingly, dummy nodes 162, 164, 166, and 
168 may be inserted into the links for flows a, d, g and h, respectively. 

The dummy nodes may be thought of as being logically equivalent to a 
link or to a repeater node which has two ports. The dummy nodes need not 
actually be inserted into the fabric as physical devices, but are useful constructs 
to act as link terminators in the layer 400. It will be apparent, however, that the 
present invention may be implemented without the use of such dummy nodes. 
In which case, flow sets which traverse the layer 400 are merged for alleviating 
port violations without regard as to whether the corresponding links actually 
terminate in the layer 400. More particularly, flow sets between the layer 400 
and source nodes may be merged for alleviating port violations at the source 
nodes and flow sets between the layer 400 and terminal nodes may be merged 
for alleviating port violations at terminal nodes. 

Also in the step 304, the dummy nodes and device nodes in the layer 
400 may be recast as terminal nodes. Thus, all of the flows which pass through 
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the layer 400 may be treated as simply terminating in the layer 400. In the 
example of Figure 9, the flow a may be treated as terminating at dummy node 
162, the flow d may be treated as terminating at dummy node 164, the merged 
flow set having flows b and c and the merged flow set having flows e and f 
5 may be treated as terminating at the device node 160, the flow g may be treated 
as terminating in the dummy node 166 and the flow h may be treated as 
terminating in the dummy node 168. The terminal nodes 50, 52 and 54 may be 
ignored in the step 304. 

Then, in a step 304, an additional layer of device nodes may be inserted 
10 between the source nodes and the layer currently closest to the source nodes. 
I, * In the example of Figure 9, the additional layer may be inserted between the 

i;«3 layer 400 and the source nodes 40, 42 and 44. In one embodiment, this 

\r\ additional layer may be formed by the method of Figure 1 . Alternately, the 

JJ, 1 additional layer may be formed by manual or other techniques. 

P 15 Assuming the method 200 of Figure 1 is employed in the step 306, the 

U port violations at source nodes may be identified (if they have not been 

,4, already) and then flow sets may be merged to alleviate the port violations. As 

£ in the method 200 of Figure 1, candidate flow sets may be evaluated prior to 

* merging to determine the feasibility of merging them, the relative magnitude of 

20 existing port violations and the potential for merging candidate flow sets to 
reduce the existing port violations and the costs of devices needed to effect the 
various possible mergers. 

In the example of Figure 9, the only port violation among the source 
nodes 40, 42 and 44, is at the source node 40 and is a port violation of one. To 
25 alleviate this port violation, the flow set having flow a and the flow set having 
the flows b and c may be merged. This is shown in Figure 10 where an 
interconnect device 170 has been inserted to merge these flow sets. Note that 
there is now a link between the device 170 and the device 160. Accordingly, 
the addition of the device 170 adds a layer to the interconnect fabric. 
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The step 306 may terminate similarly to the method 200 of Figure 1. 
Thus, the step 306 may terminate when no additional merges among flow sets 
in the newly added device layer are feasible or likely to result in a cost savings. 

Next, the determination step 302 may be repeated in which a 
5 determination is made as to whether there exist any port violations at the source 
nodes. If violations remain, then the steps 304 and 306 may be repeated to add 
another layer between the prior layer and the source nodes. This process may 
be performed recursively, each time adding a layer of devices to the 
interconnect fabric and reducing the number of port violations at the source 
10 nodes. Each new layer is added between the prior layer and the source nodes. 
Thus, in the example, if another layer were required, the layer of devices that 
includes the device 170 would next be recast as the terminal nodes. 

In the example of Figure 10, the addition of the layer that includes the 
device 170 eliminates the port violation at the source node 40. Accordingly, no 
15 additional port violations at source nodes remain and, thus, no additional layers 
are needed. Under other circumstances, however, one or more additional layers 
may be required to eliminate all such port violations. 

Once all of the port violations at the source nodes have been eliminated, 
one or more layers of device nodes may be added adjacent to the terminal 
20 nodes in order to alleviate any port violations at the terminal nodes. Thus, after 
a negative determination in the step 302, a step 308 may be performed. 

In the step 308, a determination may be made as to whether there are 
any port violations at the terminal nodes. Assuming there is one or more such 
port violations, step 310 may be performed. As mentioned, for the example of 
25 Figure 5, there is a port violation of degree one at the terminal node 52. At step 
310, the problem may be recast with a layer of device nodes treated as source 
nodes. 

Thus, in the step 310, a layer of existing interconnect fabric devices that 
is adjacent to the terminal nodes that have port violations may be identified. In 
30 the example of Figures 9 and 10, the existing device layer 400 is adjacent to the 
terminal nodes 50, 52 and 54. Accordingly, dummy nodes may be inserted as 
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shown in Figure 9. In the step 310, however, the dummy nodes and device 
nodes in the layer 400 are now recast as source nodes, rather than terminal 
nodes as in step 304. 

Thus, all of the flows which pass through the layer 400 may be treated 
5 as originating in the layer 400. In the example, the flow a may be treated as 
originating at dummy node 162, the flow d may be treated as originating at 
dummy node 164, the merged flow set having flows b and e and the merged 
flow set having flows c and f may be treated as originating at the device node 
160, the flow g may be treated as originating in the dummy node 166 and the 

10 flow h may be treated as originating in the dummy node 168. The source nodes 
40, 42 and 44 may be ignored in the step 310. 

Then, in a step 312, an additional layer of device nodes may be inserted 
between the prior layer and the terminal nodes. The example of Figure 9, the 
additional layer may be inserted between the layer 400 and the terminal nodes 

15 50, 52 and 54. In one embodiment, this additional layer may be formed by the 
method of Figure 1 . Alternately, the additional layer may be formed by manual 
or other techniques. 

Assuming the method 200 of Figure 1 is employed in the step 312, the 
port violations at terminal nodes may be identified (if they have not been 

20 already) and then flow sets may be merged to alleviate the port violations. As 
in the method 200 of Figure 1, candidate flow sets may be evaluated prior to 
merging to determine the feasibility of merging them, the relative magnitude of 
existing port violations and the potential for merging candidate flow sets to 
reduce the existing port violations and the costs of devices needed to effect the 

25 various possible mergers. 

In the example of Figures 9 and 10, the only port violation among the 
terminal nodes 50, 52 and 54, is at the terminal node 52 and is a port violation 
of one. To alleviate this, the flow set having flows b and e and the flow set 
having the flow g may be merged. This is shown in Figure 1 1 where an 

30 interconnect device 172 has been inserted to merge these flow sets. Note that 
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there is now a link between the device 172 and the device 160. Accordingly, 
the addition of the device 172 adds another layer to the interconnect fabric. 

The step 312 may terminate similarly to the method 200 of Figure 1. 
Thus, the step 312 may terminate when no additional merges among flow sets 
in the newly added device layer are feasible or likely to result in a cost savings. 

Next, the determination step 308 may be repeated to determine whether 
there exist any additional port violations at the terminal nodes. If violations 
remain, then the steps 310 and 312 may be repeated to add another layer 
between the prior layer and the terminal nodes. This process may be performed 
recursively, each time adding a layer of devices to the interconnect fabric and 
reducing the number of port violations at the terminal nodes. Each new layer 
may be added between the prior layer and the terminal nodes. Thus, in the 
example, if another layer were required, the layer of devices that includes the 
device 172 would be recast as the source nodes. 

In the example of Figure 1 1, the addition of the layer that includes the 
device 172 eliminates the port violation at the terminal node 52. Accordingly, 
no additional port violations at terminal nodes remain and, thus, no additional 
layers are needed. Under other circumstances, however, one or more additional 
layers may be required to eliminate all such port violations. 

Once all of the port violations at the terminal nodes have been 
eliminated, the interconnect fabric design may be output from the method 300 
in a step 316. The design may then be used to implement the interconnect 
fabric. 

Assuming that dummy nodes were employed while forming the 
additional fabric layers, they may be removed in the step 316. Figure 12 shows 
the interconnect fabric of the example with the dummy nodes removed. To 
accomplish this, the dummy nodes 162, 164, 166 and 168 connected links may 
each be replaced with a single link. Thus, in Figure 12, the flow set having 
flow a may pass directly from the device 170 to the terminal node 50, the flow 
set having the flow d may pass directly from the source node 42 to the terminal 
node 50, the flow set having the flow g may pass directly from the source node 
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44 to the device 172 and the flow set having the flow h may pass directly from 
the source node 44 to the terminal node 54. 

While the embodiment of Figure 8 adds layers to the interconnect fabric 
to alleviate port violations at source nodes before adding layers to alleviate port 
violations at terminal nodes, it will be apparent that port violations at terminal 
nodes may be instead addressed before port violations at source nodes are 
addresses. It will also be apparent that one or more layers may be added to 
address terminal node port violations before all of the source node port 
violations have been eliminated and vice- versa (e.g., layers may be added 
alternately on each side of the layer 400). 

The foregoing detailed description of the present invention is provided 
for the purposes of illustration and is not intended to be exhaustive or to limit 
the invention to the precise embodiment disclosed. Accordingly, the scope of 
the present invention is defined by the appended claims. 
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